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ABSTRACT 


DERIVING  TRAINING  DEVICE  IMPLICATIONS 
FROM  LEARNING  THEORV  PRINCIPLES 

VOLUME  I: 

GUIDELINES  FOR  TRAINING  DEVICE  DESIGN,  DEVELOPMENT,  AND  USE 


Investigation  was  made  of  the  feasibility  of  developing  criteria  for 
the  design,  development,  ami  use  of  training  devices  on  the  basis  of 
principles  formulated  by  current  psychological  learning  theories.  A  number 
of  Implications  for  the  training  device  situation  were  derived  from  learning 
principles  common  to  most  contemporary  theorists.  Additional  implications 
were  derived  from  principles  characteristic  of,  or  particularly  emphasized 
by,  specific  learning  theorists.  The  derived  Implications  were  presented 
as  a  set  of  guidelines  to  extend  and  amplify  present  human  factors  guides 
for  training  device  design  and  use.  These  device  implications  or  guidelines 
were  presented  In  a  tabular  format  organized  and  Indexed  according  to 
relevance  for  (!)  specific  members  of  a  nineteen  category  task/behavior 
classification  system,  and  (2)  types  of  general  design  problems,  e.g., 
stimulus  presentation,  performance  feedback,  or  operator  output. 
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FOREWORD 

Over  che  past  decade,  a  aside rabl.8  amount  of  information  underlying 
consideration  of  human  facto  >  in  the  design,  development  end  utilisation 
of  training  devices  has  been  ^cumulated.  Most  of  these  data  have  been 
obtained  from  a  wide  variety  •(  isolated  experimental  studies  and,  thus  far, 
only  limited  formulations  of  general  principles  for  training  device  design 
have  emerged.  What  has  been  1  coking  is  information  of  a  preceptive  and 
systematic  nature  which  can  be  used  in  translating  store  of  the  aveilable 
knowledge  of  the  learning  process  into  training  equipment  features. 

The  need  for  extension  and  amplification  of  the  kinds  of  information 
which  must  underlie  the  design  of  training  devices  can  be  fulfilled,  to  a 
great  extent,  on  the  basis  of  explanations  and  appraisals  of  the  functions 
of  the  training  device  in  the  basic  learning  process.  Current  theories  of 
learning  provide  comprehensive  explanations  of  the  learning  process  and 
related  phenomena,  and  application  of  these  theories  to  training  situations 
can  make  possible  the  formulation  of  guiding  principles.  Thus,  from  the 
vast  potential  contained  In  current  learning  theories,  a  means  for  system¬ 
atising  and  integrating  large  quantities  of  experimental  findings  can  be 
provided. 


In  the  present  study,  contemporary  learning  theories  have  been  reviewed, 
compared  and  recast  in  the  light  of  the  unique  features  of  the  training 
situation.  From  this  analysis  has  resulted  a  number  of  generalizations  which 
serve  au  a  basis  for  formulating  the  desired  guidelines.  The  guidelines 
presented  are  in  check-list  form  and  should  be  of  considerable  value  to 
personnel  concerned  with  training  device  development  and  utilization. 


Because  of  the  large  amount  of  material  presented  as  well  aa  the 
possible  varied  interests  in  the  subject  matter,  two  other  reports  have  been 
prepared  separately.  Technical  Report  784-2  contains  a  detailed  description 
of  the  methodology  employed  in  the  development  of  the  guidelines;  Technical 
Report  784-3  presents  an  extensive  compilation  of  specific  principles  formu¬ 
lated  by  each  of  a  representative  group  of  contemporary  learning  theorists 
and  upon  which  the  guldelin-s  for  the  design  of  training  devices  are  based. 


loiogy  Division 


E.  Hurray,  Pb.D. 
d,  Conmunicatlons  Psy< 


'Thomson'' 

Chief  Psychologist 
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INTRODUCTION 


This  report  represents  the  major  product  of  a  study  designed  to  develop 
criteria  for  the  design,  development,  and  use  of  training  devices  on  the 
basis  of  Information  contained  in  contemporary  psychological  theories  of 
learning.  The  rationale  underlying  this  study  was  the  possibility  of  ex¬ 
tending  and  amplifying  present  human  factors  guidelines  for  training  device 
design  and  use  by  means  of  an  application  of  learning  theory  principles  to 
the  training  device  situation.  The  set  of  guidelines  presented  in  this 
report  constitute  the  results  er  a  First  attempt  at  such  an  application. 


A.  Related  Reports 

A  detailed  description  of  the  methodology  employed  in  the  course  of 
this  study  is  presented  In  a  separate  report  entitled  "Deriving  Training 
Device  Implications  From  Learning  Theory  Principles,  Volume  II:  Methodol¬ 
ogy."  Another  related  report,  entitled  Deriving  Training  Device  Implica¬ 
tions  From  Learning  Theory  Principles,  Volume  III:  Specific  Learning 
Principles,"  presents  an  extensive  compilation  of  specific  principles  form¬ 
ulated  by  each  of  a  representative  group  of  contemporary  learning  theorists. 
This  large  compilation  undoubtedly  contains  many  specific  principles  which 
relate  only  indirectly,  If  at  .«II,  to  the  "Guidelines"  of  the  present 
report.  Thus,  Volume  III  may  be  considered  a  potential  source  of  additional 
impl Ir - ; t an i  or  criteria  for  the  design  and  use  of  training  devices. 


b.  Intended  Use  of  Guidelines 


The  set  of  guidelines  presented  In  this  report  may  be  used  as  a  type 
of  check-list  to  be  consulted  by  the  training  device  designer/user  as  an 
aid  In  developing  or  utilizing  training  devices.  These  guidelines,  of 
course,  must  be  regarded  as  tentative  recommendations  since  experimental 
verification  of  each  principle,  under  the  wide  range  of  conditions  udilch 
may  be  appropriate,  Is  not  available.  However,  until  the  necessary  veri¬ 
fication  is  obtained,  a  given  guideline  may  be  considered  sufficiently 
plausible  to  serve  as  a  "rule"  or  "guiding  principle"  of  practice. 

Obviously,  the  set  of  guidelines  must  not  be  used  as  if  it  were  an 
infallible  source  of  solutions  to  all  practical  training  device  problems. 
Certain  guidelines,  particularly  when  carried  to  extremes,  may  actually 
be  contrad I ctory;  hence,  the  designer  or  user  of  the  device  must  make 
the  necessary  trade-offs  on  some  basis  other  than  the  set  of  guidelines. 

The  fact  that  the  present  set  of  guidelines  presumably  represents  only  a 
core  or  group  of  the  more  prominent  members  of  the  possible  set  of  training 
device  Implications  derivable  from  learning  theory  principles  also  would 
argue  strongly  against  exclusive  reliance  upon  these  guidelines. 
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In  addition  to.  use  as  a  check-list,  the  present  set  of  guidelines 
should  serve  as  a  basis  for  (1)  extending  and  broadening  the  amount  of 
systematic,  preceptive  information  available  to  training  device  designers 
and  users,  and  (2)  experimental  investigations  of  specific  learning  theory 
implications. 


C.  Organization  of  Guidelines 

The  guidelines  are  presented  in  two  major  groups.  The  first  and 
largest  group  consists  of  Implications  derived  from  one  or  more  “common" 
learning  principles,  i.e.,  principles  common  to  most  learning  theories. 

The  second  group  consists  of  implications  derived  from  a  small  selected 
sample  of  principles  characteri Stic  of,  or  particularly  emphasized  by, 
specific  theorists.  Both  groups  are  intended  to  be  fairly  illustrative 
rather  than  exhaustive.  Although  the  first  group  of  guidelines  is  rela¬ 
tively  large,  it  must  be  considered,  likewise,  as  a  sample  or  portion  of 
the  total,  set  of  possible  device  implications  which  might  have  been  derived. 
The  criteria  used  in  determining  these  samples  are  discussed  in  the  Volume 
II  report  on  methodology. 

An  index  is  provided  to  permit  ready  access  to  certain  groups  of 
guidelines.  All  guidelines  relating  to  each  of  nineteen  types  of  task 
or  classes  of  behavior  are  identified  in  this  index.  Moreover,  within 
each  of  these  nineteen  task/bchavior  categories,  guidelines  ore  sub-indexed 
according  to  the  general  design  problem  involved  (e.g.,  displays,  perform¬ 
ance  feedback,  operator  output,  cfc.). 


0.  Tryout 

Examples  of  application  of  the  guidelines  to  two  specific  practical 
training  situations  are  presented  in  APPENDIX  B.  These  examples  were 
designed  to  illustrate  (I)  the  feasibility  of  specific  applications  of 
the  generalized  guidelines,  (2)  the  manner  in  which  the  guidelines  may 
be  applied,  and  (3)  the  type  and  variety  of  results  obtainable  from  such 
specific  appl icatlons. 


E.  Format  and  Terminology* 

Each  guideline  is  presented  on  a  separate  page  in  two  forms.  The  first 
form  is  essentially  a  summary  tabular  presentation  while  the  second  Is  a 
complete  statement  of  the  guideline  in  a  paragraph  below  the  summary  table. 


*Tht  reader  may  wish  to  refer  to  one  of  the  guidelines  on  page  5  f or 
following  while  reading  this  discussion  of  format. 
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The  first  column  of  the  summary  table  presentation  merely  identifies  the 
"Type  of  Task"  and  "Design  Problem"  with  which  the  guideline  is  primarily 
concerned.  The  "Design  Problem"  terms  are  relatively  standard  and  un- 
amb'guous-  In  contrast,  the  terminology  employed  to  describe  “Type  of  Task" 
may  need  some  clarification.  Included  in  APPENDIX  A,  therefore,  Is  a  set 
of  examples  of  operational  situations  In  which  the  nineteen  types  of  task 
are,  respectively,  prominent.  The  hard  core  of  the  guideline  is  presented 
In  the  second  column  headed  "RECOMMENDED  DESIGN  FEATURE."  A  third  column 
Is  Included  for  presentation  of  additional  details  or  clarifying  comments. 
Again,  some  of  the  terminology  used  In  these  columns  may  not  be  entirely 
meaningful,  especially  to  readers  unfamiliar  with  technical  psychological 
terms.  The  simplest  solution  In  this  case  appeared  to  be  a  "Glossary  of 
Terms,"  which  is  presented  in  APPENDIX  C  of  the  present  report. 

The  paragraph  statement  of  the  guideline,  presented  below  the  tabular 
summary,  Is  followed  by  a  source  code.  This  code  is  merely  one  or  more 
pairs  of  numbers  which  permit  Identification  of  the  particular  comblnation(s) 
of  task/behavior  category  and  learning  principle  from  which  the  guideline 
was  derived.  It  is  necessary,  however,  to  refer  to  Volume  II  on  methodology 
for  a  complete  interpretation  of  these  code  numbers. 


3 


NAVTRADRVCEH  784-1 


GUIDELINES  BASED  ON  "COMMON"  PRINCIPLES 


The  training  device  guidelines  which  follow  Immediately  on 
pages  5  through  48  are  based  on  principles  which  are  common  to 
most,  if  not  all,  contemporary  learning  theories. 

The  guidelines  are  presented  in  tabular  format,  one  guideline 
on  each  page.  The  table  for  each  guideline  highlights  the  more 
important  aspects  of  the  guideline.  Below  the  table  Is  the  complete 
statement  of  the  guideline. 

For  the  user  of  the  guidelines,  the  following  aids  are 
provided: 


a.  Task/behavior  categories  are  illustrated  in  Appendix  A, 
beginning  on  page  59- 

b.  Sample  applications  of  the  guidelines  are  presented  in 
Appendix  B,  beginning  on  page  61. 

c.  Terms  or  expressions  vrfiich  may  need  explanation  or  clari¬ 
fication  are  defined  In  the  Glossary  in  Appendix  C, 
beginning  on  page  73- 

d.  The  Index  to  the  guidelines  is  presented  in  Appendix  D, 
beginning  on  page  77. 
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In  training  for  detection  of  non-verbal  cues,  provision  should  be  made  for  maintaining  adequate 
motivation  or  alertness  over  required  periods  of  performance.  The  final  stages  of  training  should 
Involve  extended  time  intervals  during  which  the  student  must  keep  alert  if  he  is  to  perform  adequately 
on  the  detection  task.  Provision  should  be  made  to  offset  or  decrease  undesirable  motivational  effects 
such  as  fatigue  and  boredom  which  are  likely  to  result  from  the  protracted  time  intervals. 
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In  training  for  identification  of  either  verbal  or  non-verbal  cues,  the  cue  stimuli  presented  to 
the  student  should  be  as  nearly  identical  as  possible  to  the  cue  stimuli  which  the  student  will  encotn 
In  subsequent  transfer  to  job  conditions.  The  greater  the  degree  of  similarity  between  the  cues  presi 
In  the  tratning  situation  and  cues  encountered  in  the  operational  situation,  the  greater  will  be  the 
positive  transfer  from  training  to  job  conditions.  (Sources:  2-3,  4-3) 
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interfering  and  co>npeting  responses.  (Sources:  2-12,  4-12) 
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variables  Involved  in  the  particular  principles.  Presentation  of  any  cues  serving  to  elicit  recall  of 
such  variables  Mould  tend  to  facilitate  recall  of  the  principle(s)  relating  these  variables. 

(Source:  6-12) 
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development  of  recall-facilitating  "redundant"  or  supplementary  habit  systems  based  on  (1)  "response- 
produced1*  cues  arising  from  the  immediately  preceding  response  and  (2)  "temporal/sequential"  cues  based 
on  the  proportion  of  total  procedure  previously  completed.  (Source?  7-5) 
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contiguous  stimulus  context.  (Source:  7-6) 
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In  training  for  recall  of  lengthy  or  difficult  procedures,  provision  should  be  made  for  mental 
or  symbolic  rehearsal  of  sequential  steps  readily  codable  in  symbolic  form.  (Source:  7**I2) 
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response  context  which  are  specific  to  the  guided  or  artificial  training  conditions  that  removal  of 
such  cues  under  on-the-job  (non-guided)  conditions  will  result  in  decreased  performance.  (Source:  7 “6) 
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In  training  for  recall  of  lengthy  or  difficult  procedures,  provision  should  be  made  for  minimizing 
delay  of  reinforcement  (or  feedback  on  adequacy  of  performance)  following  each  "single-step"  or  "basic 
unit"  response,  especially  during  the  early  stages  of  training.  (Source:  7-7) 


22 


(giving  Information  on  adequacy  of  performance)  any  given  single  step  cr  basic  unit  of  the  procedure 
prior  to  execution  of  the  next  step.  (Source:  7-7) 
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In  training  for  recall  of  lengthy  or  difficult  procedures,  provision  should  be  made  for  gradually 
I ncreas I ng  the  delay  of  reinforcement  (i.e.,  feedback  on  adequacy  of  performance)  of  single  steps  or 
basic  units  of  the  procedure  as  training  progresses  from  one  stage  to  the  next.  (Source:  7-7) 
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rehearsal  of  sequential  steps  readily  codab le  in  symbolic  form  as  delay  of  reinforcement  *ay  be  less 
in  symbolic  than  in  overt  rehearsal,  particularly  in  later  stages  of  procedural  training  when  the 
occurrence  of  a  given  response  may  serve  as  a  reinforcement  or  indication  of  adequacy  of  the  procedlng 
response.  (Source:  7-7) 
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In  training  in  the  use  of  principles,  provision  should  be  made  for  a  large  number  of  illustrations 
or  examples  of  application  or  use  of  the  principle.  By  varying  the  stimulus  context  of  repetition 
through  use  of  examples,  the  potential  aversive  or  monotonous  effects  of  repetition  are  reduced  while 
at  the  same  time  the  trainee  is  provided  with  the  opportunity  to  acquire  new  and  finer  discriminations, 
or  in  other  words  the  subject's  "understanding"  of  the  principle  is  increased. 
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In  training  for  decision-making  under  conditions  in  which  the  alternatives  are  given,  provision 
should  be  made  for  presentation  of  ramifications  or  logical  implications  of  al ternati ves,  whenever 
poisible,  as  contiguous  parts  of  the  alternative  context.  This  may  require  time  compression  such  as 
miiht  be  provided  by  film  or  diagram  techniques  or  gaming  techniques.  (Source:  9-2) 
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expansion.  This  permits  variation  of  amounts  of  relevant  and  irrelevant  cues  for  identification  of 
possible  alternatives.  Techniques  such  as  diagrams,  films,  or  "gaming"  techniques  may  be  appropriate 
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practically  innumerable  or  in  which  a  substantial  portion  of  the  alternatives  are  unknown,  provision 
should  be  made  far  minimizing  delay  of  reinforcement  (feedback  on  adequacy  of  performance)  following 
the  identification  or  determination  of  any  given  relevant  alternative.  (Source:  3 1 —7) 
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essential  to  skilled  performance.  (Source:  I3~I2) 
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In  training  for  continuous  movements,  provide  for  presentation  of  target-cursor  relations  extrapo¬ 
lated  into  the  immediate  future  on  the  basis  of  current  response  characteristics.  Thus,  the  trainee 
can  avoid  potential  errors  before  they  actually  occur  by  simply  modifying  v*iat  is  predicted  according 
to  what  Is  required.  Techniques  for  providing  such  predictions  or  extrapolations  may  range  from  self- 
instructions  to  complicated  computerized  arrangements.  (Source:  14-il) 
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Design  Guide  No.  36 


type  of  errors  and  changes  in  total  error  pattern  throughout  the  course  of  traiging.  This  may 
continuous  measurement  of  both  frequency  and  amplitude  of  error  in  tracking  performance. 
(Source:  14-4,  14-6} 
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In  training  for  serial  movements,  provision  should  be  made  for  emphasizing  response  repetition  or 
practice  in  order  to  (1)  strengthen  individual  or  component  steps  of  the  movement  series  and  (2)  inte¬ 
grate  these  steps  into  a  smooth  sequence.  (Source:  15-12) 
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In  training  for  oral  verbalization,  provision  should  be  made  for  appropriate  recording  of  responses 
in  context.  Since  the  response  is  typically  a  complex  involving  subtle  relations  among  components,  the 
technique  of  measurement  should  provide  for  recording  the  total  complex  in  a  manner  that  permits  analysis 
of  such  subtle  relationships.  Some  of  the  newer  multiple-channel  tape  recording  devices  may  be  useful 
in  this  regard.  (Source:  17-4,  17~6) 


NAVTRADEVCEN  784-1 


<N 


O 

2 


-o 


3 

(J 


c 

31 


on 


0) 

Q 


■o  « 

v.  & 

o  u 

in  $ 
£  § 
c  a 
•-  «1 
ff  4) 
u  u 

O 
c  — 

~  o 

5T 


46 


the  symbolic  equivalents  of  the  visual  cues  presented  by  the  material  to  be  mastered.  Special  consid¬ 
eration  should  be  given  to  toe  problem  of  developing  these  symbolic  equivalents  by  optimal  units  and 
schedule  of  presentation  of  the  visual  cues.  (Source:  18-5) 
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In  training  for  non-oral,  non-written  verbalization,  provision  should  be  made  for  appropriate 
recording  of  responses.  Responses  of  this  type  are  illustrated  by  gestures,  hand  signals,  etc- 
Film  techniques  may  provide  the  most  effective  recording  of  such  responses.  (Source:  19-4) 
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GUIDELINES  BASED  ON  “SPECIFIC"  PRINCIPLES 


The  training  device  guidelines  v^tlch  follow  immediately  on 
pages  51  through  57  are  based  on  principles  characteristic  of,  or 
particularly  emphasized  by,  specific  learning  theorists. 

The  guidelines  are  presented  in  tabular  format,  one  guideline 
on  each  page.  The  table  for  each  guideline  highlights  the  more 
important  aspects  of  the  guideline.  Below  the  table  is  the  complete 
statement  of  the  guideline. 

For  the  uses  of  the  guidelines,  the  following  aids  are 
provided: 


a . 

Task/behavior  categories  are  illustrated  in  Appendix  A, 
beginning’ on  page  59. 

• 

b. 

Sample  applications  of  the  guidelines  are  presented  in 
Appendix  B,  beginning  on  page  61 . 

c- 

Terms  or  expressions  which  may  need  explanation  or  clari¬ 
fication  are  defined  in  the  Glossary  In  Appendix  C, 
beginning  on  page  73. 

d. 

The  Index  to  the  guidelines  is  presented  In  Appendix  0, 
beginning  on  page  77- 

49 
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51 


In  training  for  recall  of  facts,  principles,  or  procedures,  provision  should  be  made  for  maxi mi  zing 
control  of  the  stimulus  or  cue  conditions  and  the  reinforcement  (performance  feedback)  conditions. 
Maximal  control  of  these  critical  learning  variables  may  require  the  use  of  “teaching  machines"  or 
"programmed  learning"  techniques.  (Source:  Skinner) 


UcS,,,,,,»  ,n  tne  J5e  OT  principles,  provision  should  oe  made  for  emphasizing  the  logical 
relationships  which  exist  between  specific  applications  of  a  principle  and  the  general  principle 
itself,  i.e.,  the  relationship  of  the  ‘parts  to  the  whole.”  The  unique,  specific  features  of 
each  app  I  i  cat  ion  should  be  minimized  vdiile  the  common  relationships  to  the  general  principle  should 
be  emphasized.  (Source:  Toiman) 
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actu.il  tracking  situation.  (Source:  Spence) 
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in  training  for  difficult,  complex  continuous  or  serial  movements,  provision  should  be  made  for 
making  reinforcement  contingent  upon  properties  or  characteristics  of  the  trainee's  response,  so  that 
by  a  process  of  “successive  approximations'1  the  final,  desired  response  is  “shaped  up"  or  produced. 
Emphasis  is  on  differentiation  of  response  rather  than  on  externa)  stimulus  discrimination.  Extremely 
precise  monitoring  of  trainee's  responses  may  be  required.  (Source:  Skinner) 
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APPENDICES 


APPEND  I X  A:  Task/Behavior  Categories  with 
Examples  of  Operational  Context 


1.  Non-Verbai  Detection:  Detection  of  some  critical  physical  signal  «uch 
as  (1)  a  target  on  a  radar  scope,  (2)  an  auditory  signal  of  equipment 
malfunction,  or  (3)  a  visual  cue  for  starting  an  operating  procedure. 

2.  Non-Verbal  Identification:  Identification  of  equipment  configurations. 

3.  Verbal  Detection:  Monitoring  communications  equipment. 

4.  Verbal  Identification:  Identifying  verbal  stimuli  of  cues  such  as  codes 
and  diagrams  or  symbols  such  as  those  used  in  mathematical  arid  natural 

1 anguages. 

5.  Recal 1 1 ng  Facts;  Recall  of  Information  such  as  equipment  nomenclature 
or  function,  codes,  configurations,  locations,  etc. 

6.  Recal I ing  Principles:  Recall  of  information  such  as  complex  relation¬ 
ships  between  control  Inputs,  output  Indications,  and  possible  equipment 
ma I  functions. 

7.  Recalling  Procedures:  Recall  of  Information  such  as  procedures  Involved 
In  assembly  or  disassembly  of  a  complex  piece  of  mechanism,  replacement 
of  defective  components,  or  fueling  or  arming  a  weapon  platform. 

8.  Using  Principles,  Inferring:  Application  of  complex  relationships  such 
as  those  Involving  control  inputs,  modes  of  operation,  output  Indica¬ 
tions,  and  possible  equipment  malfunctions;  or  use  of  principles  In 
threat  evaluation  and  weapon  assignment. 

9-  Making  Decisions  -  Alternatives  Given;  Certain  types  of  complex  equipment 
malfunction  diagnosis,  complex  system  check-out,  or  threat  evaluation 
and  weapon  assignment. 

10.  Making  Decisions  -  Alternatives  Unspecified;  Certain  types  of  complex 
equipment  malfunction  diagnosis,  complex  system  check-out,  or  threat 
evaluation  and  weapon  assignment. 

11.  Making  Decisions  -  Alternatives  Unknown:  Certain  types  of  complex 
equipment  malfunction  diagnosis,  complex  system  check-out,  or  threat 
evaluation  and  weapon  assignment. 

12.  Positioning  Movement:  Handling  of  materials,  operating  controls. 

13.  Repetitive  Movement:  Turning  a  screwdriver  or  wrench,  hammering,  using 
a  hand  file  or  saw,  etc. 
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14-  Cgnt; l nt|fyii«!  Mojgasat;  Tracking  tasks  such  as  following  a  target  with 

a  gun  or  with  fire-control  equipment,  or  operating  the  steering  mechanism 
of  a  moving  vehicle. 

15*  Serial  Movement:  Typing,  radar  set  turn-on  procedures,  portions  of 
system  check-out  routines. 

16.  Static  Reaction:  Maintaining  proper  sight-target  relationship  In  aiming 
a  rifle,  holding  an  electrode  in  place  when  welding,  or  maintaining  op¬ 
timal  postural  adjustment  when  monitoring  a  radar  scope. 

1 7 •  Oral  Verbalization:  Person-to-peri»on(s)  vocal  communication  -  either 
face-to-face  or  via  electronic/mechanical  transmission. 

•8.  Wrl tten  Verbal i zatlon:  Writing  in  special  codes  or  symbols  or  In  new 
natural  or  mathematical  languages. 

19*  Other  (Overt)  Verbalization:  Use  of  conventionalized  gestures  or 

specialized  sign  languages  such  as  the  semaphore  and  the  dactylologies! 
(deaf-mute)  systems. 
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APPENDIX  8:  Examples  of  Application  of  Guideline;. 


Presented  in  this  section  are  examples  of  application  of  the  guidelines 
to  two  specific  practical  training  situations.  These  examples  serve  to 
Illustrate  the  manner  In  which  these  general  guidelines  may  be  applied  and 
provide  some  indication  as  to  type  and  variety  of  results  obtainable  from 
such  specific  applications.  Briefly,  the  manner  In  vdiich  both  applications 
were  conducted  involved  the  following  steps: 

Step  1 .  The  specific  training  problem  or  situation  was 
described  and  analyzed  In  sufficient  detail  to  be  meaningfully 
related  to  the  nineteen  task/behavior  categories  (cf.  APPENDIX  A) 
used  In  developing  and  stating  the  guidelines. 

Step  2.  On  the  basis  of  the  above  description  of  the  specific 
situation,  the  I ndex  to  the  guidelines  was  checked  for  entries 
identical  or  similar  to  those  aspects  of  the  training  situation 
which  were  identified  as  critical  task  behaviors. 

Step  3.  The  guidelines  identified  In  Step  2  were  then 
reviewed  in  the  light  of  the  specific  characteristics  or  circum¬ 
stances  of  the  situation. 

Step  4.  In  the  course  of  Step  3,  a  number  of  suggestions 
as  to  specific  design  features  occurred.  These  suggested  design 
features,  based  largely  on  the  guidelines  plus  a  knowledge  of 
significant  characteristics  of  the  specific  training  situation, 
were  recorded,  refined,  and  then  grouped  according  to  relevance 
for  particular  design  problems  such  as  displays,  feedback,  etc. 


Example  No.  1:  Adjustment  of  Telecommunications  Relays 


Brief  Description  of  Tasks:  Adjusting  leaves  of  relays  used  In  telecom¬ 
munications  systems,  so  that  contacts  make  and  break  according  to  specifica¬ 
tions.  Requires  positioning  relay  on  mounted  stand  which  connects  It 
electrically;  adjusting  clearance  between  armature  and  coll  by  screw  adjust¬ 
ment;  using  gauges  to  check  clearance;  inspecting  clearances  of  contacts; 
using  small  tools  to  bend  leaves  of  relay  pllc-up  so  that  tolerances  are 
met;  diagnosing  how  contacts  are  out  of  adjustment  and  determining  what 
adjustments  are  needed  where  to  bring  It  Into  adjustment. 

Additional  Information:  Relays  are  of  several  degrees  of  complexity  with 
any  or  all  of  three  types  of  contacts:  make,  break,  and  make  before  break. 
Electrical  test  stand  i»  not  diagnostic  to  the  point  of  specifying  which 
specific  contact  needs  adjustment,  vrfien  several  similar  contacts  are  in¬ 
volved.  Written  procedures  are  very  brief  and  require  much  Interpretation. 
Specifications  are  highly  technical  and  much  of  the  information  is  in  coded 
form.  Training  currently  requires  about  three  months,  during  which  time 
the  trainee  learns  primarily  by  watching  a  skilled  adjuster  working. 


61 


NAVTRaDBVCEN  784-1 


Critical  Task  Behaviors:  The  major  skills  to  be  developed  are  related  to 
Hie  following  behaviors: 

a.  Inspecting:  requiring  careful  visual  Inspection  against  a  white 
background,  to  observe  minute  clearances,  simultaneity  of  contact 
makes  and  breaks,  and  effects  of  adjustments  for  clearance  and 
timing. 

b.  Determining  nature  of  needed  adjustments:  From  the  Inspection, 
manipulation  and  gauging  of  the  relay,  diagnosing  which  segments 
of  the  relay  require  adjustments  of  the  kinds  the  adjuster  can 
make. 

c.  Making  manual  adjustments:  requiring  use  of  small  hand  tools  for 
bending  or  straightening  leaves  of  the  relay.  Including  Judging 
how  much  of  a  movement  or  adjustment  Is  needed,  essentially  by 
•feel11. 

d.  Generalizing  all  skills  among  various  types  and  complexities  of 
relays,  requiring  the  determi nati on  of  additional  interactions  of 
contacts  when  different  types  of  contacts  are  combined  and  when 
there  are  many  of  the  same  type  of  contact,  and  the  judgment  of 
how  these  interactions  affect  the  component  skills. 

Suggested  Design  Features  for  Displays: 

1.  Actual  relays  do  not  provide  many  of  the  features  suggested.  For 
example,  there  are  mapy  Irrelevant  cues  continuously  present  In 
actual  relays.  It  Is  difficult  to  Inspect  an  Individual  contact 
against  a  light  background,  because  there  are  so  many  other  con¬ 
tacts  also  visible  and  interacting.  It  would  be  desirable  to  pro¬ 
vide  a  simplified  relay  with  one  or  a  few  contacts  easy  to  examine. 
These  would  still  be  realistic  and  provide  transfer,  and  could  be 
made  more  and  more  complex  as  training  progresses. 

2.  If  special  training  relays  were  to  be  designed,  they  should  also 
be  constructed  so  that  the  adjustments  possible  are  fairly  obvious 
to  determine  and  so  that  the  result  of  each  possible  adjustment 
can  be  demonstrated. 

3.  Several  types  of  training  relays  should  be  designed,  to  insure 
general  I zatlon  among  types  of  pile-ups  of  leaves  and  among  types 
of  contacts. 

4.  Some  training  relays  might  be  designed  to  be  grossly  out  of  adjust¬ 
ment,  so  that  the  cues  which  would  suggest  correct  responses  are 
obvious. 
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5.  A  checking  routine  might  be  developed  to  as&i&t  in  training.  This 
routine  would  break  down  the  somev^tat  complex  relationships  among 
adjustment  possibilities,  perhaps  suggesting  priorities  of  checks 
and  adjustments,  somewhat  as  a  troubleshooting  routine  does.  The 
attempt  would  be  to  provide  a  fairly  simple  ''mediator"  for  examining 
and  working  with  the  many  possibilities  facing  the  adjuster  of  a 
complex  relay,  presented  to  him  as  a  "whole,"  without  much  of  a 
procedure  to  follow. 

6.  As  more  complex  relays  are  introduced,  the  training  relays  would 
vary  in  their  timing  of  make  and  break. 

7.  Training  relays  should  be  constructed  so  that  vrfien  the  adjuster 
begins  to  make  an  adjustment,  as  in  bending  a  leaf,  he  can  see 
what  will  result  from  more  or  less  of  the  same  adjustment.  This 
suggests  that  materials  other  than  those  used  in  actual  relays 
may  be  desirable  for  some  of  the  early  training  relays.  On  the 
other  hand,  the  training  relays  should  be  capable  of  being  re-set 

to  any  given  Inadjustment,  after  used  in  training,  implying  material 
which  can  be  shaped  and  reshaped  several  times. 

8.  There  might  be  an  easy  way  for  diagramming  or  for  using  a  large- 
scale  mock-up  of  a  relay  which  very  clearly  points  out  what  happens 
with  contacts  with  each  type  and  degree  of  adjustment.  This 
method  might  facilitate  the  understanding  of  what  happens  when 
adjustments  are  made  on  either  side  of  a  fulcrum  In  a  lever-type 

of  arrangement,  and  the  advantages  of  each  type  of  adjustment. 

9.  For  the  fast,  fairly  repetitive  types  of  adjustments,  such  as 
making  very  slight  adjustments  of  each  leaf  In  the  relay  In  quick 
succession,  a  film  In  slow  motion  might  help  to  show  the  action, 
although  the  value  of  such  a  film  might  not  be  worth  the  cost  for 
production.  A  slowed-down  demonstration  might  do  as  well. 

10.  In  the  analysis  of  where  to  make  the  adjustments,  a  simplified 

diagram  with  exploded  views  of  adjustment  ureas  might  clarify  and 
help  encod**  the  analysis  process.  For  example,  arrows  could  con¬ 
nect  trouble  and  Its  correction  In  a  "if  this,  then  this"  type  of 
presentation.  This  might  help  to  develop  some  geographical,  physi¬ 
cal  associations  more  easily  remembered  than  more  logical  or  abs¬ 
tract  relationships. 


Suggested  design  Features  for  Operator  Output: 

I.  Obviously,  extensive  practice  will  be  necessary,  both  to  develop 

the  manual  skills  of  handling  the  tools  and  to  develop  the  analyzing 
skills  for  determining  what  to  adjust  and  where.  To  provide  re¬ 
petitive  manual  practice,  some  special  training  materials  might  be 
developed  on  which  the  operator  can  practice  making  bends  of  various 
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degree  and  which  he  can  check  with  a  standard  of  some  kind.  These 
would  not  necessarily  be  as  parts  of  relays.  The  trainee  might 
even  take  a  long  strip  of  metal  which  he  must  shape  a  certain  way 
with  his  hand  tools.  The  shaping  must  progress  very  gradually, 
and  can  be  checked  for  accuracy  at  each  of  several  stages. 

2.  Any  training  relays  specially  designed  should  provide  for  varia¬ 
tions  in  operator  response,  so  that  in  some  cases,  very  small  and 
few  adjustments  are  necessary  and,  in  other  cases,  much  larger  or 
more  numerous  adjustments  are  required. 

3*  The  training  equipment  should  provide  a  means  for  showing  the 
trainee  inmediately  the  consequences  of  a  given  adjustment.  It 
should  first  show  him  that  something  does  happen  when  he  responds 
(e.g.,  that  there  is  a  bend,  however  small,  when  he  applies 
pressure  with  a  small  bending  tool).  Then  it  should  show  him  that 
this  "something"  varies  in  proportion  to  his  response  (e.g.,  the 
more  he  applies  pressure,  the  greater  the  bend).  Finally,  it  should 
show  him  what  will  happen  In  the  relay* s  action  for  one  or  more 
variations  in  this  response  (e.g.,  if  too  much,  another  contact 
will  be  affected;  if  too  little,  there  Is  virtually  no  adjustment). 
With  the  simplified  relays  for  early  training,  this  type  of  con¬ 
sequences  information  should  be  easier  to  incorporate  than  with 
more  complex  relays. 

4.  The  variety  of  training  relays  should  provide  a  selection  of  lengths 
or  materials  in  the  leaves.  If  there  is  this  variation  In  the 
actual  relays,  so  that  the  trainee  can  learn  to  differentiate  the 
responses  required  for  each  type  of  relay. 

5.  The  armatures  of  the  early  training  relays  should  be  much  more 
delicate  or  more  nearly  linear  in  response  to  applied  force,  so 
that  the  contacts  can  be  made  or  broken  slowly,  instead  of  Jumping 
as  they  do  now  with  the  amount  of  prossure  on  the  armature  which 
Is  needed  to  move  the  relays. 

6.  Perhaps,  In  early  training,  require  the  trainee  to  verbalize  what 
he  Is  doing  and  why,  either  aloud  or  on  a  ''scrambled"  checklist, 
so  that  his  recall  responses  can  be  checked. 


Suggested  Design  Features  for  Performance  Feedback: 

I.  Perhaps  the  best  type  of  feedback  on  a  specific  adjustment  response 
woi.tld  be  that  of  an  electrical  check  which  would  indicate  that  the 
rtifly  t  a  wi  1  v  tivi  hww  in  adjustment.  If  possible,  the  test  stand 
and  the  design  of  the  relay  should  be  such  that  contacts  can  be 
singled  out  for  electrical  checks,  and  that  each  of  a  pair  of  oon- 
tact  points  can  be  isolated  electrically.  This  might  be  done  only 
with  very  simple  training  relays,  it  points  up  an  advantage  to 
starting  with  single  point  relay  contacts,  instead  of  having  double 
points  for  each  contact. 
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2.  Early  in  training*  feedback  should  be  given  quickly  and  often*  after 
the  response  is  made.  As  training  progresses*  feedback  should  be 
less  quick  and  less  complete.  This  would  probably  be  compatible 
with  an  Increase  In  the  complexity  of  the  relays  during  training. 

3.  There  should  be  some  means  for  reinforcing  the  learner  in  his  analysis 
of  the  relay  and  in  his  selection  of  alternatives  for  adjustment* 
especially  early  In  training.  Perhaps  he  could  analyze  the  problem* 
then  select  his  alternative*  and  then  check  on  a  checklist.  This 
would*  of  course*  permit  cheating*  unless  some  form  of  self-teaching 
machine  were  used*  requiring  a  written  response  first.  This  is 
perhaps  too  impractical  and  unrealistic*  but  worth  some  further 
thought. 

4.  Other  design  features  suggest  self-instruction,  because  of  the  emphasis 
on  reinforcement.  However*  the  checking  of  adjustment  responses  al¬ 
most  precludes  any  automatic  way  for  reinforcement.  For  some  bending 
tasks*  the  final  bend  might  be  checked  against  a  standard  of  some 
kind*  like  a  line  which  the  edge  of  the  leaf  should  conform  to  or 

a  jig  In  which  the  leaf  should  fit  easily. 


Suggested  Oeslan  Features  for  Personal  Environment: 

1.  Vary  training  tasks  at  beginning  to  sustain  Interest.  For  example, 
the  trainee  might  spend  an  initial  bit  of  time  on  learning  about 
different  types  of  contacts,  then  work  with  his  tools  on  a  simple 
adjusting  or  shaping  task,  and  then  learn  a  little  about  analyzings  - 
what  kind  of  adjustment  Is  needed*  etc.  As  training  progresses, 
variations  in  types  and  complexity  of  relays  will  help  sustain 
interest.  Don't  spend  too  much  time  on  the  visual  discrimination 

at  any  one  time. 

2.  A  variety  of  teaching  methods  will  help  avoid  fatigue  also.  For  . 
example*  If  sel f-lnstructlon  is  possible  for  any  part  of  the  train¬ 
ing,  vary  linear  and  branching  materials.  Intersperse  the  person- 
to-person  Instruction  with  demons  tret  lour,  or  other  teaching  media. 


Discussion  and  Illustration  of  the  Derivation  of  Oaslgn  Features: 

The  steps  leading  to  two  of  the  above  suggested  design  features  are 
traced  in  order  to  Illustrate  In  greater  detail  the  manner  in  which  the  ap¬ 
plication  was  carried  out: 

Derivation  of  Suggested  Design  Feature  No,  5  (for  Displays) : 

Step  I.  In  the  analysis  of  the  specific  training  problem*  one 
task  was  described  as  diagnosing  how  contacts  are  out  of  adjustment 
and  determining  what  adjustments  are  needed  vrfiere  to  bring  it  Into 
adjustment-" 
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Step  2.  The  entry  "Making  Decisions  -  Alternatives  Unknown"  In  the 
Index  to  the  guidelines  appeared  to  be  sufficiently  similar  to  the  task 
or  behavior  described  In  Step  I  to  warrant  a  follow-up.  Several  guide¬ 
lines  were  grouped  under  this  entry.  Including  "Design  Guide  No.  27" 
which  Is  presented  on  page  29.  This  guideline,  stated  briefly,  is  as 
follows:  "In  training  for  decision-making  under  conditions  In  which 
the  number  of  possible  alternatives  is  practically  Innumerable,  or  in 
which  a  substantial  proportion  of  the  alternatives  are  unknown,  provi¬ 
sion  should  be  made  for  the  development  and  use  of  mediators  (stereo¬ 
types,  self-lnstructlons,  or  'natural'  associations)  both  for  facilita¬ 
ting  Identification  of  response  alternatives  and  for  reinforcement  of 
such  identifying  responses  when  they  occur.  Such  mediators  might  be 
largely  semantic  or  verbal  in  nature,  e.g.,  instructions  as  to  what 
constitutes  the  genera!  class  of  events  known  as  'alternatives,'  or 
rules  for  Implicit  testing  of  alternatives." 

Step  3»  Design  Guide  25,  Identified  in  Step  2,  was  thus  reviewed 
in  the  light  of  the  specific  characteristics  of  the  situation.  Includ¬ 
ing  the  following:  (I)  "Electrical  test  stand  Is  not  diagnostic  to 
the  point  of  specifying  which  specific  contact  needs  adjustment,  when 
several  similar  contacts  are  Involved,"  (2)  "Written  procedures  are 
very  brief  and  require  much  Interpretation." 

Stop  4.  In  the  course  of  Step  3,  the  following  design  feature 
was  suggested:  "A  checking  routine  might  be  developed  to  assist  In 
training.  This  routine  would  break  down  the  somewhat  complex  relation¬ 
ships  among  adjustment  possibilities,  perhaps  suggesting  priorities  of 
checks  and  adjustments,  somewhat  as  a  troubleshooting  routine  does. 

The  attempt  would  be  to  provide  a  fairly  simple  "mediator"  for  examin¬ 
ing  and  working  with  the  many  possibilities  facing  the  adjuster  of  a 
complex  relay,  presented  to  him  as  a  'whole',  without  much  of  a  proced¬ 
ure  to  follow." 


Derivation  of  Suggested  Design  feature  No.  I  (for  Personal  Environment): 

Step  1 .  One  critical  task  behavior  Identified  in  analysis  of  the 
specific  training  problem  was  “Inspecting:  requiring  careful  visual 
Inspection  against  a  white  background,  to  observe  minute  clearances, 
simultaneity  of  contact  makes  and  breaks,  and  effects  of  adjustments 
for  clearance  and  timing." 

Step  2.  The  Index  entry  "Non-Verbal  Detection"  appeared  relevant. 
One  of  the  guidelines  covered  by  this  entry  was  “Design  Guide  No.  3" 
which  Is  presented  on  page  7.  In  brief,  this  guideline  is  as  follows: 
“In  training  for  detection  of  non-verbal  cues,  .  .  .  .provision  should 
be  made  to  offset  or  decrease  undesirable  motivational  effects  such 
as  fatigue  and  boredom  which  are  likely  to  result  from  the  protracted 
time  intervals." 
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Step  3*  Design  Guide  No.  3,  Identified  In  Step  2,  was  then 
reviewed  in  the  light  of  specific  characteristics  of  the  situation, 
Including  the  following:  (I)  "Relays  are  of  several  degrees  of  complex¬ 
ity.  .  ."  (2)  "Training  currently  requires  about  three  months,"  and  (3) 

.  .trainee  learns  primarily  by  watching  a  skilled  adjuster  working." 

Step  4.  In  the  course  of  the  Step  3  review,  the  following  design 
feature  was  suggested:  "Vary  training  tasks  at  beginning  to  sustain 
interest.  For  example,  the  trainee  might  spend  an  Initial  bit  of  time 
on  learning  about  different  types  of  contacts,  then  work  with  his  tools 
on  a  simple  adjusting  or  shaping  task,  and  then  learn  a  little  about 
analyzing  what  kind  of  adjustment  is  needed,  etc.  As  training  progresses, 
variations  in  types  and  complexity  of  relays  wi I  1  help  sustain  interest. 
Don't  spend  too  much  time  on  the  visual  discrimination  at  any  one 
time." 


Example  No.  2:  Operating  Portion  of  Communications  System 

Brief  Description  of  Task:  Advances  call  to  station:  selects  appropriate 
outgoing  circuit;  plugs  in;  performs  necessary  operations  of  dialing,  key 
pulsing,  ringing,  or  requesting:  if  necessary,  monitors  to  determine  that 
connection  Is  complete  t.o  station;  determines  call  status. 

Additional  Information:  The  selection  of  appropriate  circuit  is  dependent 
upon  the  type  of  call  and  the  equipment  capabilities.  There  are  specific 
procedures  and  practices  to  cover  these  alternatives.  Once  selected,  the 
plug-in  is  made,  and  again  depending  upon  the  type  of  cal)  and  circuit,  the 
operator  has  several  alternatives  for  the  next  step;'  to  key  pulse  a  number, 
to  dial  a  number,  to  ring  ori  a  ringing  key  and  remain  cut  in  until  party 
answers,  or  to  wait  for  an  .answer.  She  may  pass  information  on  to  another 
operator  in  order  t.o  build  up  a  connection,  in  which  case  she  may  have  to 
clear  the  circuit  vcrbaliy  when  the  call  is  finished.  If  the  call  cannot 
be  completed,  she  determines  why  not  and  selects  an  alternative  course  of 
action  or  a  report  to  be  given  to  the  customer. 

Critical  Task  Behaviors:  Although  there  are  many  things  involved  here,  the 
major  skills  are  as  follows: 

a.  Recalling  procedures  and  principles:  She  must  remember  specific 
steps  to  be  followed  for  specific  situations  and  conditions,  and 
she  must  remember  principles  or  rules  governing  some  of  these 
procedures  and  steps. 

b.  Making  decisions/alternatives  known:  She  generally  has  a  proced¬ 
ure  to  Follow  or  a  principle  to  use  as  a  guide. 

c.  Ident i f i ca t i on/non-verba i  cues:  She  must  quickly  search  the  swi tch- 
board  circuits  for  appropriate  locations,  and  she  must  watch  her 
supervision  lights,  two  very  crucial  search  and  monitoring  skills. 
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Suggested  design  Features  for  Displays: 

1.  It  seems  most  likely  that  call  advancing  should  be  trained  substanti¬ 
ally  on  a  piece  of  equipment  very  much  like  the  actual  switchboard. 

This  will  maximize  transfer  to  actual  equipment.  The  main  questions 
then  become  ones  of  how  much  simulation  of  advancing  capabilities 

to  provide,  with  necessary  feedback. 

2.  Alternatives  for  selecting  outgoing  circuit  groups  can  be  grouped 
into  a  relatively  few  types.  These  categories  can  be  set  up  to  be 
more  easily  remembered  than  each  of  the  many  specific  alternatives. 

3.  Alternatives  for  advancing  are  in  large  part  dependent  upon  the 
type  of  route  to  be  used  for  the  call,  e.g.,  whether  the  call  can 
be  advanced  directly  to  a  telephone  or  whether  It  must  be  passed 
through  one  or  more  other  operators.  These  call  types  can  easily 
be  grouped  for  easy  remember ing.  Fur  example,  direct  to  telephone 
routes  will  be  listed  in  the  reference  guide  with  a  +  or  70  on  the 
end.  All  routes  through  other  operators  do  not  end  in  +  or  70.  This 
grouping  is  easier  to  remember  than  all  the  specific  combinations  of 
routes  and  codes. 

k.  A  training  board  should  provide  a  broad  enough  selection  of  outgoing 
circuits  to  allow  application  of  principles  to  selection  of  alterna¬ 
tives.  Therefore,  there  should  be  a  jack  for  each  general  type  of 
circuit.  For  example,  If  there  ore  three  "tandemf1  circuits  with 
several  jacks  each,  there  should  be  one  active  jack  for  each  tandem 
on  the  training  board.  However,  If  there  are  two  or  more  areas  for 
one  type  of  tandem,  there  need  not  be  an  active  jack  In  each  area. 

The  active  jacks  in  the  tandem  should  not  always  be  the  first  In  the 
row,  but  perhaps  In  the  first  five.  It  should  have  an  idle-indicating 
lamp  as  on  an  actual  switchboard.  If  there  arc  several  specific  city 
groups  of  jacks  on  the  actual  swl tchboard,  such  as  to  New  York,  Boston, 
Philadelphia,  etc.,  or  more  local  areas  such  as  Glenshaw,  Evans  City, 
and  Oakrnont,  the  training  board  should  have  an  active  jack  in  a  few 
of  these  areas,  but  not  necessarily  in  all  of  them.  Calls  In  train¬ 
ing  can  be  limited  to  those  areas  represented  on  the  training  board. 
This  can  be  generalized  to  the  other  areas  with  brief  practice  and 
drill  on  the  actual  board. 

5<  Tha  selection  of  area  jacks  discussed  above  should  include  a  sample 
of  each  type  of  advancing  procedure.  For  example,  if  tnere  are  cir¬ 
cuits  direct  to  a  ringdown  (meaning  that  the  operator  has  to  ring 
the  telephone  herself),  a  few  of  these  should  be  included. 

6.  In  early  training,  when  the  trainee  is  concentrating  on  a  specific 
type  of  advancing,  the  switchboard  can  be  marked  with  tape,  for 
example,  to  limit  her  search  and  the  number  of  alternatives  availa¬ 
ble  to  her.  As  training  progresses,  this  can  be  eliminated. 
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7.  Whan  the  advancing  requires  several  steps,  sometimes  drawn  out 
over  several  minutes  because  of  waits,  in  early  training  these  can 
be  time-compressed,  so  that  the  sequence  becomes  clear.  This  will 
permit  greater  drawing  of  parallels  between  these  procedures  and 
those  for  more  direct  calls. 

8.  In  early  training,  the  call  Information  can  be  presented  so  that  the 
“heart"  of  the  call  Is  obvious,  so  that  the  decision  and  alternatives 
are  clear.  As  training  progresses,  the  call  information  presenta¬ 
tion  can  vary  as  widely  as  customers  tend  to  present  It. 

9.  Where  the  operator  has  alternative  methods  of  advancing  for  different 
types  of  calls,  these  alternatives  can  be  presented  so  that  they  are 
associated  with  the  consequences  of  each  alternative.  For  example, 
you  can  do  either  A  or  B.  If  you  do  A,  this  is  what  happens;  if  B, 
this  Is  what  happens.  Which  do  you  want  to  happen  here? 

10.  The  call  advancing  procedures  can  be  supported  by  a  “supplementary 
habit  systenf'  which  emphasizes  on  one  hand  the  logical  order  required 
by  the  steps  (c.g.,  you  have  to  connect  yourself  to  a  telephone  be¬ 
fore  you  can  ring  It)  or  on  the  other  hand  the  physical  relationship 
among  the  steps  (e.g.,  the  Information  from  the  calling  party  comes 
In  on  one  cord  and  has  to  go  out  on  the  other  cord  to  some  place 
before  you  can  talk  or  rlnq  at  the  called  party's  telephone  or  an¬ 
other  operator). 

11.  In  the  early  learning  of  sequences,  numbered  tags  could  be  affixed 
to  critical  points  of  the  equipment  In  accordance  with  the  sequence 
to  be  followed.  For  example  a  I  could  be  put  at  the  incoming  jack; 
a  2  at  a  point  indicating  the  operator  or  her  earphones;  a  3  at  the 
outgoing  jack;  a  4  at  the  ringing  key  or  on  the  monitoring  key;  a  5 
on  the  cord  clips;  and  a  6  on  the  supervision  lights.  This  would 
make  the  sequence  physically  obvious  and  easy  to  fol low  without 
Initial  error. 

12.  The  various  types  of  call  status  conditions  should  be  carefully  simu¬ 
lated,  to  develop  discrimination  between  various  frequencies  of 
flashing  lights,  for  example.  Early  in  training,  these  differences 
can  be  exaggerated,  so  that  a  regular  flashing  Is  easily  dlscrimlnable 
from  an  irregular  flashing,  for  example. 


Suggested  Design  Features  for  Operator  Output: 

1.  Provide  plenty  of  examples  of  the  same  type  of  call  for  extensive 
practice. 
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2.  Space  out  the  steps  of  the  sequence  to  be  foi lowed  so  that  each 

single  cue  can  be  associated  with  Its  specific  response.  For  example, 
when  the  supervision  light  comes  on  at  the  end  of  conversation,  the 
operator  may  remove  cord  clips,  release  the  circuits  verbally  to  an¬ 
other  operator,  and  then  disconnect.  This  sequence  should  be  divided 
so  that  the  cord  clip  removal  is  a  cue  to  ring  the  other  operator  and 
clear,  ans'  that,  in  turn,  is  the  cue  to  disconnect. 

3-  As  training  proceeds,  reduce  the  amount  and  kind  of  special  cueing 
from  Step  to  Step. 

4.  Encourage  the  operator  to  go  through  the  steps  of  the  call  advance¬ 
ment  mentally.  For  example,  while  the  call  is  up,  the  operator  can 
rehearse  in  her  mind  the  final  steps  to  be  carried  out  when  the 
supervision  light  comes  on. 

5.  Provide  a  large  number  of  i ! I ustrat ions  of  calls  with  slight  differ¬ 
ences  but  which  require  the  same  principle  to  he  applied.  For  ex¬ 
ample,  there  are  several  types  of  calls  on  which  the  operator  remains 
cut  in  until  the  called  party  answers.  A  variety  of  these  will  help 
to  generalize  Lhe  principle  of  remaining  cut  in. 

b.  Early  in  training,  the  instructor  may  wish  the  student  to  state  what 
action  she  will  perform  next,  su  that  accuracy  of  recall  can  be 
measured . 

1.  develop  training  sequences  so  that  content  Is  in  most  logical  order, 
in  appropriately  small  steps,  and  with  adequate  explanation  at  each 
point,  so  that  there  is  minimal  dependence  on  Initial  level  of  per¬ 
formance.  Initial  training  design  should  probably  oe  evaluated  by 
checking  on  how  effective  it  is  for  students  with  differing  abilities 
at  beginning. 

H.  Early  in  training,  the  student  might  be  permitted  to  plug  into  only 
a  few  specific  areas  of  the  board,  thus  controlling  her  response 
somewhat.  This  would  be  broadened  as  training  progresses  until  she 
is  permitted  to  use  the  entire  board. 


Suggested  Oesign  Features  for  Performance  Feedback : 

I.  Early  in  training,  students  can  be  reinforced  after  each  step  of 
the  sequence  and  immediately.  This  is  especially  true  If  self- 
instructional  methods  are  applied.  Sequence  recall  might  be  trained 
and  practiced  through  a  branching  type  of  program,  so  that  if  the 
student  makes  a  wrong  response,  she  is  told  it  is  wrong  and  why, 
before  going  on  to  the  next  step. 
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2.  Later  in  training,  the  student  would  be  reinforced  primarily  after 
completing  the  advancement  of  the  call.  This  Is  more  typical  of 
the  operational  situation. 

3.  if  the  student  is  required  to  mentally  rehearse  the  sequence,  she 
should  be  reinforced,  corrected  If  necessary,  as  she  goes  along. 
Later  In  training,  the  reinforcement  will  be  primarily  at  the  end 
of  the  sequence. 


evaluation  of  Applicability  of  Guidelines 

On  the  basis  of  the  previous  examples,  It  appears  that  the  present 
set  of  guidelines  are  capable  of  fruitful  application  to  specific  practi¬ 
cal  training  situations.  This  Is  not  to  say  that  the  results  of  the 
applications  presented  would  have  bean  unobtainable,  In  whole  or  In  port, 
without  the  guidelines.  It  Is  not  possible  to  separate  exactly  the  con¬ 
tribution  of  the  guidelines  from  the  contribution  played  by  knowledge  of 
the  specific  practical  situation  and  knowledge  of,  and  creativity  In,  the 
general  area  of  training  methods,  techniques,  equipment,  etc.  Nevertheless, 
it  seems  likely  that  the  set  of  guidelines  may  play  a  particularly  useful 
role  as  a  "memory  jogger"  or  check-list  to  complement  the  memory  of  the 
training  device  designer  or  user. 

Perhaps  o  substantial  factor  contributing  to  the  apparent  usefulness  of 
the  guidelines  Is  the  organization  In  terms  of  categories  of  tasks  or  behav¬ 
iors  and,  secondarily,  categories  of  general  design  problems.  With  this 
type  of  organization  (and  Indexing),  it  becomes  unnecessary  to  read  through 
large  quantities  of  material  unrelated  to  the  specific  problem  of  the  moment 
in  order  to  find  Isolated  bits  of  relevant  Information. 

In  conclusion,  the  set  of  guidelines  appear  to  be  capable  of  useful 
application  to  specific  practical  training  situations,  at  least  if  applied 
in  the  manner  summarized  below: 

Step  1.  Prepare,  or  otherwise  obtain,  0  descriptive  analysis  of  the 
specific  training  problem  or  situation  in  sufficient  detail 
to  bo  meaningfully  related  to  the  nineteen  task  or  behavior 
categories  used  in  developing  and  stating  the  guidelines. 

(cf.  APPEND  I X  A) 

Step  2.  Check  I ndex  to  guidelines  for  entries  identical  or  similar 

to  those  aspects  of  the  training  situation  which  are  consid¬ 
ered  critical  task  behaviors. 

Keview  guidelines  identified  in  Step  1  in  the  light  of  the 
specific  characteristics,  requirements,  or  circumstances  of 
the  training  situation. 
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Step  4.  Record  and  refine  suggestions  as  to  specific  design  features, 
details,  etc.  which  occur  in  the  course  of  Step  3*  This  Is, 
perhaps,  the  most  critical  step,  depending  heavily  on  the 
knowledge  and  creativity  of  the  reviewer. 
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APPENDIX  C:  Glossary  of  Terms 


alternative  (choice)  context  -  Stimulus  context  ir»  which  the  stimuli  con¬ 
sist  of  alternatives  or  choices  in  a  decision-making  situation.  These 
alternatives  or  choices  must  be  presented  or  perceived  at  approximately 
the  same  point  in  time  in  order  to  be  considered  portions  of  the 
same  context. 

ana  lytic  (diagnostic)  Indicators  -  Data  capable  of  facilitating  analysis 

of  performance  in  terms  of  various  meaningful  aspects  of  the  under¬ 
lying  learning  process.  Such  data  may  reflect,  for  example,  rate 
as  well  as  level  of  learning,  motivational  as  well  as  skill  level, 
or  projected  points  of  maximal  response  interference  or  difficulty, 
implies  data  providing  a  more  “fine-grained"  account  of  trainee 
performance  than  is  required  for  simple  evaluation  in  terms  of 
typical  performance  criteria. 

anticipatory  symbo 1 1 c  response  -  Covert  (i.e.,  mental,  'Mn-the-hcad,"  not 

directly  observable)  equivalent  or  concomitant  of  an  overt  (directly 
observable)  response,  the  symbolic  equivalent  occurring  prior  to 
its  corresponding  overt  response. 


codab le  In  symbol i c  form  -  Expressible  or  representable  in  words  or  other 
symbols. 

cue-rcsponse  pattern  -  A  learned  combination  and/or  arrangement  (spatial 
and/or  temporal)  of  specific  responses  and  associated  cues  or 
initiating  signals.  See  hab I t  system. 

cue-response  step  -  Portion  of  a  required  procedure  or  performance  which 
entails  the  execution  of  a  specific  response  (or  appropriate  sub¬ 
stitute)  to  a  given  cue  (or  appropriate  substitute). 


f eedback  -  Information  presented  or  otherwise  made  available  to  trainee 

Indicating  adequacy  of  performance.  Sometimes  termed  "knowledge  of 
results."  See  reinforcement. 


general Ization  (Stimulus  general ization)  -  Tendency  of  a  given  cue  to 

elicit  or  produce  a  given  response  solely  on  the  basis  of  similarity 
to  another  cue  (or  to  other  cues).  Implies  at  least  partial  equi¬ 
valence  of  different  cues  in  evoking  a  learned  response. 
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guidance  or  '‘artificial"  components  of  total  response  context  -  Refers  to 
aspects  of  response  which  occur  primarily,  If  not  exclusively,  be¬ 
cause  of  special  guidance  features  which  are  Introduced,  usually 
early  In  training,  to  limit  or  control  trainee’s  response  In  some 
desired  respect.  See  total  response  context. 


habl t  system  -  A  set  of  Interrelated  habits  (learned  cue-response  relation¬ 
ships).  See  cue-response  pattern. 


implicit  testing  of  al ternati ves  -  Refers  to  symbolic  evaluation  of 

alternatives  (or  choices)  In  a  decision-making  situation.  Implies 
a  simulated  try-out  of  alternatives,  l.e.,  estimating  probable 
'•onsequences  of  given  courses  of  action  as  opposed  to  actually 
determining  alternative  consequences. 

Individual  differences  -  Variation  with  respect  to  abilities  (or  other 
characteristics)  among  individuals. 

i nterferlng  and  competing  responses  -  Responses  which  are  to  some  extent 
I  ncoinpatible-  wi  th  the  to-be- learned  response.  Occurrence  of  such 
(i.e,,  interfering)  responses  implies  a  lowered  probaollity  of 
occurrence  of  the  desired  or  t:o-be- learned  response.  Complete  ex¬ 
tension  of  one1  5  arm,  for  example,  is  incompatible  with  complete 
flexion  of  the  same  arm,  i.e.,  one  response  precludes  or  prevents 
the  other  at  any  given  point  in  time. 

i rrelcvant  cues  -  Extraneous  cues  which,  because  of  their  transient  nature, 
arc  inappropriate  or  inadequate  os  signals  for  the  desired  or  to-be- 
learned  response. 


kinesthetic  cues  -  Cues  based  on  "muscular  feel,"  l.e.,  stimuli  which 
occur  as  the  result  of  muscular  activity.  Such  cues  have  their 
origin  in  muscle  tissue,  tendons,  or  joints. 


met!  i  a  tor  -  Response  which  facilitates  the  development  of  an  association 

between  some  other  response  and  a  given  cue  by  serving  as  a  sort  of 
"go-between"  or  "link"  between  the  given  cue  and  the  other  response. 
Implies  that  the  given  cue  is  fairly  capable  of  eliciting  the  media¬ 
ting  response,  and  that  the  mediating  response  then  serves  as  a  more 
adequate,  i.e.,  stronger,  signal  for  the  desired  response  than  does 
the  given  cue  which  originally  elicited  the  mediating  response.  For 
example,  the  cue  "I"  is  fairly  capable  of  eliciting  the  response  "2" 
which,  in  turn,  is  a  more  adequate  or  stronger  signal  for  "2  r". 
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(assuming  this  is  the  desired  response)  than  Is  the  original  cue 
"1.“  In  this  example  the  response  "2“  Is  the  mediator  or  link 
between  the  given  cue  "I4*  and  the  desired  response  "2  r." 


“natural11  association  -  Highly  overlearned  cue-response  relation.  Implies 
high  probability  of  response  upon  presentation  of  given  cue.  Hay 
be  useful  as  a  mediator. 


overlearning  -  Practice  or  response  repetition  carried  beyond  the  point 
of  mastery. 


positive  transfer  -  Facilitating  effects  of  previous  learning  experience 
upon  subsequent  learning  performance. 

“programmable11  according  to  stage  of  training  -  Refers  to  capability 

of  organizing  and  scheduling  one  or  more  fearers j  of  tho  training 
situation  according  to  the  stage  of  training  or  relative  progress 
of  t he  trainee. 


redundant  or  supplementary  habi t  system  -  A  habl t  system  or  cue-response 
pattern  characterized  by  the  following  features:  (I)  usually 
superfluous,  i.e.,  non-essential  to  successful  performance  as 
long  as  Some  other  habit  system  remains  adequate,  (2)  capable  of 
producing  successful  performance  in  the  event  that  another,  usually 
adequate,  system  breaks  down,  os  might  occur,  for  example,  under 
stress  or  in  the  case  of  particularly  difficult  or  complex  tasks. 

reinforcement  -  The  action  of  some  event  upon  a  response  such  that 

the  response  is  strengthened.  In  human  learning  "knowledge  of 
results"  or  performance  feedback  is  usually  considered  to  act 
as  a  reinforcement.  See  feedback . 

relevant  cues  -  Appropriate  or  adequate  signals  for  the  desired  or  to-be- 
learned  response.  Those  cues  to  which  the  trainee  should  attend 
or  respond  in  order  for  the  most  efficient  looming  performance 
to  develop. 

response-produced  cue  -  Stimulus  or  cue  produced  or  determined  by  a  given 
response.  Implies  that  the  response  itself  Is  a  cue  or  signal  for 
some  other  response. 
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sel f- 1  ns  truct ions  -  Instructions  which  trainee  provides  himself  through 
recall  or  other  symbolic  responses.  Cues  for  such  responses  may 
be  either  symbolic  (covert,  "in-the-head,"  not  directly  observable) 
or  overt  (directly  observable). 

sense  modal i ties  -  Methods  or  classes  of  sensory  input,  e.g.,  visual, 
auditory,  tactual,  etc. 

"si ngie  step"  or  "bas i c  uni t"  response  -  See  cue- response  step . 

"specific  step"  external  cue  -  Stimulus  or  signal  for  a  given  response, 
the  stimulus  being  presented  by  some  source  (e.g.,  equipment, 
instructor,  materials,  etc.)  other  than  the  trainee  himself. 

Also  implies  that  the  response  in  question  is  only  a  portion  of 
some  performance  sequence  or  procedure. 

stereotypes  -  Common  cliches,  movements,  gestures,  postures,  or  other 
highly  standardized  responses. 

s  t i mu  I u  s  rcccp  t i on  -  Activation  or  arousal  of  sensory  receptors  (sense 
organs)  be  a  stimulus.  Implies  that  the  stimulus  becomes  an 
actual  input  to  the  trainee. 

symbol i c  (mcnt  a  I )  rehearsal  -  Repetition  (practice)  of  symbolic  response(s). 
See  symbol i c  response. 

symbol i c  response  -  Covert  ( i . c . ,  mental,  " i n- thc-head"  not  directly  obser- 
vable)  equivalent  or  concomitant  of  an  overt  (directly  observable) 
response. 


tempora  1  /  sequent  i  al  cues  *  Cues  based  on  the  proportion  of  -i  total 
procedure  or  sequence  of  responses  which  has  been  previously 
completed.  Implies  that  such  cues  indicate  to  the  trainee 
"where  he  is"  in  the  procedure  or  sequence,  and  thus  provide 
■in  indirect  indication  of  the  appropriate  next  response. 

to to !  cue  context  (stimulus  context)  -  The  entire  set  of  cues  or  sensory 
i inputs  occurring  simultaneously  with  some  specified  single  cue. 
Implies  that  the  set  of  accompanying  cues  is  complete,  i.e.,  includes 
every  other  sensory  input  regardless  of  origin,  relevance,  etc. 

total  re sponse  context  -  The  entire  set  of  response  occurring  simultane¬ 
ously  with  some  specified  single  response.  Implies  that  the  set 
of  accompanying  responses  Is  complete,  i.e.,  includes  every  other 
response  irrespective  of  origin,  relevance  to  the  to-be- 1  ear ned 
performance,  etc. 
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APPENDIX  D: 


Continuous  movement: 

feedback  on  performance,  41,  55,  56 
operator  output,  37,  39*  40,  55,  56 
stimulus  or  cue  presentation,  36,  37,  38,  55 

Making  decisions  -  alternatives  given; 
feedback  on  performance,  53,  54 
operator  output,  26,  53,  54 
personal  environment,  53 
stimulus  or  cue  presentation,  5,  27,  53 

Making  decisions  -  alternatives  unknown: 
feedback  on  performance,  30,  31 
operator  output,  26 

stimulus  or  cue  presentation,  5,  28,  29 

Making  decisions  -  alternatives  unspecified: 
operator  output,  26 
stimulus  or  cue  presentation,  5,  28 

Non-verbal  detection: 

feedback  on  performance,  6 
personal  envi ronmunt,  I 
Stimulus  or  cue  presentation,  5 

Non-verbal  identification; 

stimulus  or  cue  presentation,  8,  9,  10 

Oral  verbalization: 

operator  output,  45 

Other  (overt)  verbalization  (f.e.,  non-oral,  non-written  verbalization) 
operator  output,  48 
stimulus  or  cue  presentation,  47 

Positioning  movement: 

operator  output,  32 

Kecal I ing  facts: 

feedback  on  performance,  51 

operator  output,  13 

stimulus  or  cue  presentation,  51 
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Recalling  principles: 

feedback  on  performance,  51 

operator  output,  13 

stimulus  or  cue  presentation,  14,  51 


Recalling  procedures: 

feedback  on  performance,  21, 
operator  output,  13,  16,  17, 
Stimulus  or  cue  presentation. 


22,  23,  24,  51 
18,  19,  20,  24 
•5,  19,  51,  57 


Repet i t i ve  movement : 

feedback  on  performance,  35 
operator  output,  33,  34 


Serial  movement: 

feedback  on  performance,  35,  5.5 
operator  output,  42,  56 

stimulus  or  cue  presentation,  33,  57 


Static  reaction: 

operator  output,  44 

personal  environment:  fatigue,  boredom 
stimulus  or  cue  presentation,  44 


Condi t i ons, 


44 


Using  principles,  inferring: 
operator  output,  2f>.  26 
stimulus  or  cue  prosentat i on,  25,  52 


Verbal  detection: 

stimulus  or  cue  presentation,  II 


Verbal  identification: 
operator  output,  12 

stimulus  or  cue  presentation,  8,  9,  10 


Written  verbalization: 
operator  output,  46 
stimulus  or  cue  presentation,  46 
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